Rapid Recovery of Very Large Memory Resident Data Objects

نویسنده

  • C. F. Chong
چکیده

Advancements in technology have enabled many computer vendors to offer computer systems with gigabytes of memory at affordable prices. The availability of an abundance of real memory in a computer creates new opportunities for software designers — very large data objects can be made memory resident to support very efficient processing. However, crash recovery becomes more time consuming because of the large amount of memory resident information that need to be saved and restored. In this paper, we propose an efficient recovery scheme based on mapping very large memory resident data objects to files. The underlying memory mapped file mechanism will propagate updates on the data objects to the mapped files automatically and checkpointing these data objects becomes a simple matter of forcing the operating system to write out all dirty buffers associated with them. Changes to data objects in between checkpoints are logged. Recovery is accomplished by restoring the most recent checkpoint and then redoing all the changes logged since this checkpoint to bring the system back to where it is immediately before the crash.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The Starburst Long Field Manager

Starburst is an experimental database management system prototype whose objectives include extensibility, support for knowledge databases, use of memory-resident database techniques, and support for large objects. We describe the structure of the Starburst long field manager, which was designed to manage large database objects such as voice, image, sound and video. The long field manager uses t...

متن کامل

Asynchronous Logging and Fast Recovery for a Large-Scale Distributed In-Memory Storage

Large-scale interactive applications and online graph analytic processing require very fast data access to many small data objects. DXRAM addresses these challenges by keeping all data always in memory of potentially many nodes aggregated in a data center. Data loss in case of node failures is prevented by an asynchronous logging on flash disks. In this paper we present the architecture of a no...

متن کامل

An Intelligent Vision System on a Mobile Manipulator

This article will introduce a robust vision system which was implemented on a mobile manipulator. This robot has to find objects and deliver them to pre specified locations. In the first stage, a method which is named color adjacency method was employed. However, this method needs a large amount of memory and the process is very slow on computers with small memories. Therefore since the previou...

متن کامل

Size Oblivious Programming with InfiniMem

Many recently proposed BigData processing frameworks make programming easier, but typically expect the datasets to fit in the memory of either a single multicore machine or a cluster of multicore machines. When this assumption does not hold, these frameworks fail. We introduce the InfiniMem framework that enables size oblivious processing of large collections of objects that do not fit in memor...

متن کامل

C++ Objects in Db2

In today's heterogeneous development environments, application programmers have the responsibility to segment their application data and store relational data in RDBMSs, C++ objects in OODBMSs, SOM objects in OMG persistent stores, and OpenDoc or OLE compound documents in document les. In addition, they must deal with multiple server systems with diierent query languages as well as large amount...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1996